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ABSTRACT 

Deutsch  [4]  has  suggested  that  some  problems  of  best  simultaneous 
approximation  might  profitably  be  viewed  as  problems  of  best  approximation  in 
an  appropriate  product  space.  A  few  authors  have  touched  upon  this  approach; 
none,  however,  have  pursued  it  consistently  or  developed  a  complete  problem 
along  such  a  line,  even  in  the  simplest  of  cases.  In  this  paper,  we  show  that 
Deutsch' s  suggestion  can  easily  be  carried  out  using  known  results  from 
approximation  theory  to  establish  existence,  uniqueness,  and  characterization 
results.  An  algorithm  guaranteed  to  converge  strongly  to  the  element  of  best 
simultaneous  approximation  under  certain  circumstances  is  also  proposed. 
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SIGNIFICANCE  AND  EXPLANATION 


A  basic  problem  of  best  simultaneous  approximation  is  the 
following.  Given  a  set  S,  two  (or  more)  points  not  in  S,  and 
(possibly  different)  measures  of  the  distances  from  the  points  to 
the  set,  find  the  element  of  S  which  is,  in  some  sense,  simul¬ 
taneously  closest  to  the  given  points  not  in  S.  Deutsch  [4]  has 
suggested  that  some  problems  of  best  simultaneous  approximation 
might  profitably  be  viewed  as  problems  of  best  approximation  in  an 
appropriate  product  space.  A  few  authors  have  touched  upon  this 
approach;  none,  however,  have  pursued  it  consistently  or  developed 
a  complete  problem  along  such  a  line,  even  in  the  simplest  of 
cases.  In  this  paper,  we  show  that  Deutsch' s  suggestion  can 
easily  be  carried  out  using  known  results  from  approximation 
theory  to  establish  existence,  uniqueness,  and  characterization 
results.  An  algorithm  guaranteed  to  converge  strongly  to  the 
element  of  best  simultaneous  approximation  under  certain 
circumstances  is  also  proposed  ^ 


The  responsibility  for  the  wording  and  views  expressed  in  this 
descriptive  summary  lies  with  MRC,  and  not  with  the  author  of  this 
report. 


A  CHARACTERIZATION  OF  AN  ELEMENT  OF 
BEST  SIMULTANEOUS  APPROXIMATION 

R.  W.  Owens* 

1 ♦  INTRODUCTION 

Let  X  be  a  Banach  space  with  norm  1*1,  M  a  subset  of 

2 

X,  and  x4,x_  e  X\M.  Let  1*1  be  a  norm  on  R  •  The  best 
I  i  a 

simultaneous  approximation  (BSA)  problem  to  be  considered, 
referred  to  as  problem  (P),  iss 

(P)  Find  m  e  M  minimizing  {l(lx1*-mlf  lx2-ml)lol  m  e  m}  . 

Without  further  conditions  upon  X,  M,  1*1,  and  1*1  ,  * 

solution  of  (P)  may  either  not  exist  or  not  be  unique*  Existence 
and  uniqueness  results  for  many  choices  of  X,  M,  I • I ,  and  1*1 

(ft 

are  known;  see  Sahney  and  Singh  [16]  for  a  recent  survey  of  many 

such  results.  Throughout  this  paper,  X  will  be  a  strictly 

convex  and  reflexive  Banach  space,  M  a  closed  subspace  of  X, 

2 

and  the  norm  ***a  on  R  will  be  strictly  convex  and  strictly 
monotone  increasing  in  each  coordinate  on  {(x,y)|x,y  >0}. 

Characterizations  of  an  element  of  BSA  come  in  several 
different  forms;  again  [16]  gives  a  detailed  overview  of  these 
results.  Several  authors,  e.g.  Diaz  and  McLaughlin  [5,  6], 

Dunham,  [7],  Holland  et.al.  [10,11],  Ling  [12],  and  Milman  [14], 
have  reduced  the  problem  of  BSA  to  a  simpler  problem  of  best 
approximation  of  a  single  element,  often  a  weighted  mean  of  the 
points  to  be  approximated;  others,  e.g.  Brosowski  [2],  Dunham  [7], 
and  Subrahmanya  [21],  employ  alternation  systems;  while  still 
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others,  e.g.  Goal  et.al.  [8],  Milman  [14],  and  Phillips  et.al. 
[15],  give  characterizations  in  terns  of  one  or  more  linear 
functionals  for  which  certain  conditions  are  met.  It  is  this 
latter  route  along  which  this  paper  proceeds  and  upon  which  the 
proposed  algorithm  is  based. 

In  Section  2,  we  specify  notation,  recast  the  BSA  problem  as 
a  problem  of  best  approximation  in  a  product  space,  and  establish 
the  existence  and  uniqueness  of  the  solution.  In  Section  3,  we 
introduce  a  dual  problem  in  terms  of  which  our  characterization 
result  is  given.  An  algorithm  and  a  guarantee  of  stong  conver¬ 
gence  when  N  has  finite  co-dimension  is  presented  in  Section 
4.  Finally,  in  Section  5,  generalizations  or  extensions  of  the 
theory  are  established. 


2.  BASIC  NOTIONS 


Let  Z  ■  X  •  X  =  {(x,y)|x,y  e  X},  N  =  {(m,m)|m  e  M} ,  and 
b  ■  (xi ,  x2>.  Nora  Z  with  |z|  -  l(lxl,  ly I ) I where 
z  m  (x,y)  e  Z.  The  strictly  monotone  increasing  assumption  on 
1*1  ensures  that  | • I  satisfies  the  triangle  inequality?  the 
other  conditions  needed  for  (*(  to  be  a  norm  on  Z  are  clearly 
satisfied.  Note  also  that  |*|  is  strictly  convex. 

Thus  Z  is  a  strictly  convex  and  reflexive  Banach  space  with 
norm  |*|,  N  is  a  closed  subspace  of  Z,  and  b  e  Z\N.  Problem 
(P)  can  be  rephrased  as  a  simple  best  approximation  problem: 

(P)  Find  n  e  N  minimizing  {|b-n||n  e  N}. 

Clearly  the  two  formulations  of  problem  (P)  are  equivalent  so 
throughout  this  paper  no  distinction  between  them  will  be  made. 

It  is  known  [17]  that  problem  (P)  has  a  unique  solution. 

For  a  norraed  linear  space  Y,  denote  by  Y*  the  dual  space 
of  Y,  and  for  f  6  Y*,  let 

Ifl  -  sup{ | f < y > 1 1 y  e  Y,  lyl  -  1}. 

Let  S  »  {y  e  Y|  lyl  «  1}  and  S*  =*  {f  e  Y*|lfl  *  1}.  If  A  C  Y, 
then  A1  -  {f  e  Y*|f(a)  =0  Va  e  A} ,  and  similarly  if  AC  Y*, 
then  A1  -  (y  e  Y|f(y)  -  0  Vf  e  A}. 

2.1  Defintlon.  If  f  e  Y*\{0},  then  y  6  S  is  called  a  dual 

vector  for  f  if  f(y)  “  Ifl. 

As  is  well  known  [22]: 

2.2  Theorem.  If  Y  is  reflexive  and  f  e  Y*\{0),  then  there  is 

at  least  one  dual  vector  for  f.  Moreover,  if  Y  is  strictly 

convex,  then  the  dual  vector  is  unique. 

Under  the  assumptions  on  X  given  above,  each  f  e  Z*\  {0} 
has  a  unique  dual  vector  which  will  be  denoted  by  f#. 
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3 .  DUAL  PROBLEM 


Given  problem  (P)  we  can  associate  with  it  a  dual  problem  (D). 
(0)  Find  f  e  N1  n  s*  maximizing  {f(b)|f  e  N1  ^  S*} . 


It  is  known  [17]  that  problem  (D)  has  a  soltuion,  and  by  an 
application  of  the  Hahn-Banach  Theorem,  see  e.g.  [3],  we  have  that 

inf  l(lx  -ml,  lx  -ml)l  -  sup  f(b).  (3.1) 

meM  a 

feN  ns* 

The  specific  characterization  result  that  we  desire  is  a 
special  case  of  the  following  lemma.  The  lemma  is  certainly 
known,  but  we  have  been  unable  to  locate  it  in  the  literature. 

For  completeness,  a  sketch  of  the  proof  is  included. 

3.1  Lemma.  Let  Y  be  a  strictly  convex  Banach  space  and  K  a 
subspace  of  Y.  For  b  e  Y  we  denote  by  (£)  and  (I>)  the 
follwoing  primal  and  dual  problems. 


{V)  Find  yeK  such  that  lb-yQl  **  inf  Ib-yl. 

0  yeK 

(D)  Find  f  e  O  S*  such  that  f(b)  ■  sup  f(b). 

fexVis* 

Suppose  also  that  inf  Ib-yl  =  p  >  0.  Then  (P)  has  a  solution 
yeK 

Yg  if  and  only  if  the  solution  f  of  (D_)  has  a  dual  vector 

f*,  in  which  case  yQ  ■  b  -  f(b)f*. 

Proof  sketch!  We  first  observe  that  whether  (£)  has  a  solution  or 

not,  (D)  does,  see  e.g.  Luenberger  [13],  so  that  the  existence  of 

f  is  assured.  Moreover,  as  in  the  derivation  of  (3.1),  we  have 

that  f(b)  “  inf  Ib-yl  *  p  >  0.  It  is  also  well  known,  see  [1]  or 
yex  _ 

[18],  that  due  to  the  strict  convexity  of  Y,  f  is  unique. 

The  calculation 

I b-yQ I  *  lf(b)f*l  =  f(b)lf*l  -  f(b)  -  p 
shows  that  if  f*  exists,  then  y^  »  b  -  f(b)f*  solves  (P.) » 


Conversely,  let  yQ  be  the  solution  of  (JP) .  He  show  that 
(b-yQ)/f(b)  is  the  dual  vector  for  f.  Since  f(b)  >0,  f  #  0. 
Also,  f((b-y0)/f<b))  -  1  -  Ifl  since  yQ  e  K  and  f  e  K1  n  s*. 
Thus  by  Definition  2.1,  f*  ■  (b-yg)/f(b),  and  solving  for  y^ 
we  obtain  the  desired  formula  for  yQ  . 

The  hypotheses  under  which  our  BSA  problem  is  being  con¬ 
sidered  ensure  the  applicability  of  Lemma  3.1.  He  have  taken  Z 
to  be  strictly  convex.  Moreover,  since  Z  was  chosen  to  be 
reflexive  and  N  a  closed  subspace  of  z,  N  is  proximinal  so 
that  for  any  b  e  Z  the  primal  problem  has  a  unique  solution. 

Thus  the  dual  vector  for  the  solution  of  problem  (D)  will  exist 
and  the  solution  of  problem  (P)  can  be  formulated  in  such  terms. 

Rephrasing  the  lemma  in  the  specific  terms  of  our  BSA 
problem,  we  have  the  following  characterisation  of  the  solution  of 
our  original  problem. 

3.2  Theorem.  Let  f  be  any  solution  of  the  dual  problem  (D). 
Then  (i)  there  exists  a  unique  m  6  M  such  that,  with  n  -  (m,m), 
b  -  f(b)f*  -  n,  and  (ii)  m  is  the  solution  of  (P). 
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4.  ALGORITHM 

The  problem  formulation  and  characterization  result  of  the 
previous  section  follow  an  approach  used  by  Sreedharan  [19]  to 
determine  solutions  of  overdetermined  systems  of  linear  equations. 
The  approach  and  algorithms  introduced  by  Sreedharan  were  later 
generalized  by  Anton  and  Duris  [1].  Since  only  minor  modifica¬ 
tions  of  the  algorithm  given  by  Anton  and  Duris  [1]  for  computing 
a  solution  of  the  dual  problem  (D)  are  needed,  we  present  only  the 

algorithm  and  the  main  convergence  result.  The  reader  is  referred 

to  [1]  for  the  proofs;  the  changes  needed  are  minor  and  straight¬ 
forward. 

4.1  Definition.  Let  W  be  a  finite  dimensional  subspace  of 
Z*  and  let  B  *  (g^,  g  , ..^g^}  be  a  basis  for  W.  The  pro¬ 
jection  of  Z  onto  W  relative  to  B  is  defined  to  be 

k 

Fs  Z  -*•  W  by  F(  z)  “  £  g  ( z)g  . 

i-1  1 

Note  that  F(z)  «  0  if  and  only  if  z  e  W  . 

Motivation  for  an  algorithm  to  compute  a  solution  of  problem 

(D)  comes  from  the  following 

4 . 2  Lemma .  Let  f  e  N  n  S*  with  f(b)  >  0,  and  let 

Fs  Z  -*•  (N  U  tb})"*-  be  the  projection  of  Z  onto  (N  U  {b})^ 
relative  to  any  basis  B  of  (N  u  {b})^  .  Then  f  solves 
problem  (D)  if  and  only  if  F(f*)  *  0. 

Proof :  See  [  1 ] . 

Led  by  this  characterization  of  a  solution  of  the  dual 
problem  (D),  the  following  algorithm  is  proposed  for  the  solution 
of  problem  (D)  when  the  subspace  M,  equivalently  N,  has  finite 
codimension. 

4.3  Algorithm.  Step  (1):  Select  a  basis  B  =  {g1 ,g2» • • .g^)  for 
w  *  (N  U  {b})^,  and  let  F  be  the  projection  of  Z  onto  W 

relative  to  B.  Set  i  *  0. 

Step  (2);  Choose  fQ  e  N  D  S*  with  fQ(b)  >  0. 

Step  (3):  Compute  h^  =  F(f*). 
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Step  (4):  If  h  =  0,  then  f  ^  solves  problem  (D)  by  Lemma 
4.2;  if  h^  *  0  then  go  to  step  (5). 

Step  (5):  Determine  a  such  that 

If.  -  ah  I  <  If.  -  Xh,  I  VX  e  R. 
i  i  i  i 

Vahi 

Step  (6):  Set  f  *  If  _ah~'|  *  increase  i  by  1,  and  go 

i  i 

to  step  ( 3 ) . 

4.4  Theorem.  Let  Z  and  Z*  be  uniformly  convex  and  let  N 
have  finite  codimension.  Then  Algorithm  4.3  either  produces  a 
solution  of  problem  (D)  in  a  finite  number  of  steps  or  generates  a 
sequence  f^  which  converges  strongly  to  the  solution  of  problem 
(D). 

The  proof  of  the  convergence  of  Algorithm  4.3  can  be  found  in 

[1].  Sreedharan  [18,  19,  20]  has  developed  several  variations  of 

the  algorithm.  In  addition,  he  discusses  l  and  weighted  t 

P  P 

cases  including  the  computation  of  dual  vectors  needed  both  in 
step  (3)  of  the  algorithm  and  in  finding  the  solution  of  problem 
(P)  once  the  solution  of  the  dual  problem  is  known. 


5.  CONCLUDING  REMARK 


Consider  the  following  more  general  problem  of  simultaneous 
approximation  of  n  elements: 

Find  m  e  M  minimizing 

{ 1  (*x1“*,0  *  1  x2"m,a  *  * ‘  *'  ,xn“m,a  )'a|B  e  ' 
t  2  n  1 

where  the  n  norms  1*1  »  i-1,2,...,n,  are  strictly  convex  and 

°i 

the  norm  l»l  on  R  is  strictly  convex  and  strictly  monotone 

increasing  in  each  of  its  n  components  on  {(y. ,.../y  )|y.  >  0} . 

i  n  l 

Each  of  the  results  of  this  paper  extends  easily  to  encompass  such 
a  problem. 
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